Robustness and Outlier Detection in Chemometrics

نویسندگان

  • Michiel Debruyne
  • Sanne Engelen
  • Mia Hubert
چکیده

In analytical chemistry, experimental data often contain outliers of one type or another. The most often used chemometrical/statistical techniques are sensitive to such outliers, and the results may be adversely affected by them. This paper presents an overview of robust chemometrical/statistical methods which search for the model fitted by the majority of the data, and hence are far less affected by outliers. As an extra benefit, we can then detect the outliers by their large deviation from the robust fit. We discuss robust procedures for estimating location and scatter, and for performing multiple linear regression, PCA, PCR, PLS, and classification. We also describe recent results concerning the robustness of Support Vector Machines, which are kernel-based methods for fitting non-linear models. Finally, we present robust approaches for the analysis of multiway data.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Novel Application of Near-infrared Spectroscopy and Chemometrics Approach for Detection of Lime Juice Adulteration

The aim of this study is to investigate the novel application of a ‎handheld near infra-red spectrophotometer coupled with classification methodologies as a screening approach in detection of adulterated lime juices. For this purpose, a miniaturized near infra-red spectrophotometer (Tellspec®) in the spectral range of 900–1700 nm was used. Three diffuse reflectance spectra of 31 pure...

متن کامل

Novel Application of Near-infrared Spectroscopy and Chemometrics Approach for Detection of Lime Juice Adulteration

The aim of this study is to investigate the novel application of a ‎handheld near infra-red spectrophotometer coupled with classification methodologies as a screening approach in detection of adulterated lime juices. For this purpose, a miniaturized near infra-red spectrophotometer (Tellspec®) in the spectral range of 900–1700 nm was used. Three diffuse reflectance spectra of 31 pure...

متن کامل

Outlier Detection in Wireless Sensor Networks Using Distributed Principal Component Analysis

Detecting anomalies is an important challenge for intrusion detection and fault diagnosis in wireless sensor networks (WSNs). To address the problem of outlier detection in wireless sensor networks, in this paper we present a PCA-based centralized approach and a DPCA-based distributed energy-efficient approach for detecting outliers in sensed data in a WSN. The outliers in sensed data can be ca...

متن کامل

Exploring authentic skim and nonfat dry milk powder variance for the development of nontargeted adulterant detection methods using near-infrared spectroscopy and chemometrics.

A multinational collaborative team led by the U.S. Pharmacopeial Convention is currently investigating the potential of near-infrared (NIR) spectroscopy for nontargeted detection of adulterants in skim and nonfat dry milk powder. The development of a compendial method is challenged by the range of authentic or nonadulterated milk powders available worldwide. This paper investigates the sources ...

متن کامل

Chapter 1 OUTLIER DETECTION

Outlier detection is a primary step in many data-mining applications. We present several methods for outlier detection, while distinguishing between univariate vs. multivariate techniques and parametric vs. nonparametric procedures. In presence of outliers, special attention should be taken to assure the robustness of the used estimators. Outlier detection for data mining is often based on dist...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2006